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Abstract 

We study different extended formulations for the set X = {x E \ Ax = 
Ax'^} in order to tackle the feasibility problem for the set X+ = XnZ" . Here the 
goal is not to find an improved polyhedral relaxation of conv(X+), but rather 
to reformulate in such a way that the new variables introduced provide good 
branching directions, and in certain circumstances permit one to deduce rapidly 
that the instance is infeasible. For the case that A has one row a we analyze the 
reformulations in more detail. In particular, we determine the integer width of 
the extended formulations in the direction of the last coordinate, and derive a 
lower bound on the Frobenius number of a. We also suggest how a decomposition 
of the vector a can be obtained that will provide a useful extended formulation. 
Our theoretical results are accompanied by a small computational study. 

1 Introduction 

Recently, several hard integer programming feasibility problems have been success- 
fully tackled using a lattice reformulation proposed by Aardal et al. [HIS]. These prob- 
lems include various equality knapsacks of Cornuejols et al. [7], Aardal and Lenstra 
[4], market split instances of Cornuejols and Dawande [6l[T], and financial planning 
instances of Louveaux and Wolsey [13] • 

The approach proposed earlier is to replace the feasibility problem for the set 
X = {x G I Ax = Ax^} by a feasibility problem over an extended formulation for 
the set, namely the set {{x, fi) € xZ""™ | x = x^+Qfi} where Q is a reduced basis 
of the lattice {y € [ Ay = 0}. It turns out that both a special purpose branch-and- 
bound code and commercial mixed integer programming solvers are then much more 
successful at solving the test instances with the extended formulation than with the 
original formulation. In related work Aardal and Lenstra [3] have considered knapsack 
sets {x eZ1\ax = b} where a = Mip^ + Khp^ , Mi, M2 e Z>o, € Z", where 

the vectors and are short compared to the length of a. For such instances they 
have used the reduced basis approach to detect a good direction for branching and to 
demonstrate infeasibility for large values of 5, and they theoretically derive a strong 
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lower bound on the Frobenius number of a in the special case when M2 = 1 and 

Here we pursue this lattice viewpoint. In Section [2] we show that the formulations 
presented above are just two extremes of a family of extended formulations of the 
original set X taking the form {{x,fi) € x Z'^ | Px = Px^ + T/x} with s addi- 
tional variables and m + s constraints with < s < n — m, where each row of A can 
be expressed as an integer multiple of the rows of P. Note that whereas in polyhedral 
combinatorics extended formulations are typically used to provide better polyhedral 
approximations of conv{X), here the extended formulations do not change the under- 
lying polyhedron. However by isolating good branching directions, the formulations 
are made more effective for treatment by branch-and-bound. 

In Section [3l we consider the special case of knapsack sets when m = 1 and 
a = Mipi -|- M2p^. For the reformulation with two equations and one additional 
variable (s = 1), we calculate the integer width of the underlying polyhedron in the 
direction of the auxiliary variable /x. This in turn leads us to a lower bound on the 
Frobenius number, simplifying and generalizing the earlier proof from [4j cited above. 

In Section 14.11 we make precise how hidden structure in A can be detected by 
reduced basis calculations, and also how this leads to interesting reformulations. In 
Section 14.21 we demonstrate computationally examples of hidden structure, we test 
how effective the reformulations are in solving feasibility problems, and we examine 
the quality of the lower bounds on the Frobenius number. 

1.1 Preliminaries 

In the following we will frequently refer to lattices and reduced lattice bases. We will 
define and describe these briefly here. For a more detailed exposition, see for instance 
Cassels [5], Kannan [8], Lenstra [HI US], and Lovasz [13] . 

Let foi, . . . , 6' be linearly independent vectors in M". The set 

I 

L = {xe M" \x = Y^ Xjb^, Xj G Z, l<j<l} 
i=i 

is called a lattice. The set of vectors {b^, . . . , 6'} is called a lattice basis. The lattice 
generated by the basis B is denoted by L[B). If B is clear from the context we write 
just L. 

Suppose A is an integer m x n matrix of full row rank. Then N{A) = {x G M" | 
Ax = 0}, i.e., N{A) is the null-space of A. We use the notation L{N{A)) to denote 
the lattice that is generated by a basis of all integer vectors in N{A). 

The rank of a given lattice L, rk L, is equal to the dimension of the Euclidean 
vector space generated by a basis of L. 

Let B = (foi, . . . , b') be a basis for a given lattice L, and let b^* , . . . , 6"* be the 
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associated Gram-Schmidt vectors, which are derived recursively as foUows. 

b^* = and b^* = V - fijkb^*, 2<j<l, 

k=l 

where 

^^,k = m^b'^*)/i\\b'*\\''), l<k<j<l. 

The basis B = (b^ , . . . ,b^) of the lattice L is reduced in the sense of Lenstra- 
Lenstra-Lovdsz [TO] if the following holds: 

l/^jfcl < ^ forl<A;<j<Z, 



Wb^* + /ijj_ifo(-''-^)*||2 > ^[|6(i-i)*[|2 for 1< i < L 

Such a basis can be found in polynomial time using the so-called LLL algorithm [lUj . 

We will also need to find a basis Q of L{N{A)) and a vector satisfying Ax^ = b, 
if such a vector exists. They can be found by reducing the basis of the lattice defined 
by the columns of the (n + m + 1) x (n + l)-matrix 



B 



where A^i and are appropriately chosen positive integers, see [3]. The first n — m+1 
columns of the reduced basis B' will be 






(1) 



If there does not exists vector x^ satisfying Ax^ = b, then element b'^_^_l n-m+i of ^' 
will be equal to zt/cA^i for some integer A; > 1, indicating that there exists a vector x 
satisfying Ax = kb. 

The Hermite Normal Form of a matrix A E ^™x" gf full row rank, HNF(A), 
is obtained by multiplying A by an n x n unimodular matrix U to obtain the form 
(-D, 0), where D G '^rnxm -g ^ nonsingular, nonnegative lower triangular matrix 
with the unique row maximum along the diagonal. The Hermite Normal Form can be 
calculated in polynomial time using for instance the LLL algorithm, see [E], or that 
of Kannan and Bachem [9]. Note that when D ^ I, the matrix D~^A is integral and 
}im{D~^A) = {I, 0). 

We will need to use one property concerning projections of equality sets over the 
reals. 
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Lemma 1 Let C and D be rational matrices of dimension m x n and m x p respec- 
tively, and let b be a rational m-vector. If 

T = {oj G I there exists y eW with Cx + Dy = b} , 

and if A is a basis of N{D^), then 

T = {a; G R" I A^Cx = A^6} . 

Proof: Multiplying by A-^, it is immediate that G R" | there exists y G 
W with Cx + Dy = b} C {a; g | A'^Cx = A'^b} as A^D = 0. If the in- 
clusion is strict, there exists x* G R" such that A^Cx* = A^b, but {y G R^ | 
Dy = b — Cx*} = 0. This implies the existence of a vector u such that uD = 
and u{b — Cx*) ^ 0. Howeever as A is a basis of N{D'^), there exists v such that 
u = vA^ . But now u{b - Cx*) = vA^{b - Cx*) = 0, a contradiction. □ 

The set of nonnegativc (positive) integers in R" is denoted by Z" (Z"q). Similar 
notation is used for the nonnegative real numbers. 

2 Formulations for equality constrained integer programs 

Our goal in this section is to derive reformulations of the integer programming equality 
set 

X = {xelI'\Ax = b} 

and the associated afHne set 

Y = {xeW'\Ax = 6}, 

where A G Z™^" and b £ 17^. Later these will be used in testing feasibility or 
optimizing over the set = X n Z" . 

Throughout the paper we will assume that X ^ %. This can be tested by calcu- 
lating HNF(A). Note that for any point x^ G X, we can then write X = {x E Z'^ \ 
Ax = Ax^}. 

We will be dealing with the kernel lattice L{N{A)) = {y G Z" | Ay = 0}. We 
assume that rank(A) = m, so rk (L{N[A))) = n — m. 

The following is immediate as £C G X if and only if £c — £C° G L{N{A)). 

Observation 2 Let Q e Z"^("-"^) be a lattice basis of L{N{A)). Then 

X = {x^} + L{N{A)) = {x\x = x'^ + Qn, /i G 7."}. 

Now we derive a larger family of reformulations of the set X. Specifically suppose 
that two matrices P G Z("*+«)^" and M G Z"*^("^+*) are given satisfying A = MP. 
Two natural questions are: 
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1. Under what conditions does there exist an extended formulation for X of the 
form 

X = {x G Z" I Pa; = Px^ + Tn,fj.e Z'} 

where T G 

2. How should one choose the matrices P, M, T so as to obtain "interesting" 
extended formulations? 

We will use the following notation: 

[/^'^ = {(a;, /x) G Z" X I Pa; = Pa;° + T/i} and X^'^ = proj3,[/^'^. 

V^ '^ = {{x, fi) G M" X 1 Pa; = Px^ + T/j}, and F^'^ = proj^F^'^. 

Here, proj^.C/'^'^ = {a; G Z" | there exists G Z* with {x,fi) G f/-^'-^}. In this 
notation X = X"^'^ and Observation [2] states that X = X^'^ when Q is a lattice 
basis oiN{L{A)). 

In Propositions [3] and m below we address the first question, and derive conditions 
ensuring that X = X^'^ . 

Proposition 3 Suppose that A, P and M are given with P G z(™+*)><"'^ M G 
jrnx(m+s) and A = MP. Then 

X = X^'^ 

i/T G z(™+^)>^'^ is a lattice basis of L{N{M)). 

Proof: If a; G X^'^, then there exists /i such that {x, /x) G U^'^. Left multiplying 
by M, we see that MPx = MPx^+MT^l = MPx^, or Ax = Ax^. So X^ '^ C X. 

Conversely a; G X implies that Ax = Ax^, or that MP{x — x^) = 0. As P{x — 
xO) e and T is a lattice basis of L{N{M)), P{x - x°) = Tfi for some G Z". 

Thus X C X^'^. □ 

Note that a slightly stronger statement can be made. 
Proposition 4 // the Hermite Normal Form of P is of the form (1,0), then 
X = X^'^ 

if and only ifT G z(™+^)^'* is a lattice basis of L{N{M)). 

Proof: Necessarily if X = X-*^'^, then the columns of T lie in L{N{M)). If they 
do not form a lattice basis, there exists t* G L{N{M)) that is not in the sublattice 
L(T). Also, as HNF(P) = (/,0), there exists x* such that Pa;* = t* . Now the 
point y* = x^ + x* lies in X as Ay* - Ax^ = Ax* = MPx* = Mt* = 0, but 
P{y* - a;0) = Px* = t* ^Tfi for any /x G Z^ and thus X ^ X^-^. □ 
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Here we address the second question specifying one way to choose appropriate 
matrices P and T. The more restrictive conditions imposed will be used in Sections 
[3l and [CT] to make "good" choices using reduced bases. 

Consider a sublattice L' of L{N{A)) of rank < r < n — m with lattice basis 
R £ Z"><^ and Q = {R, S) an extension to a basis of L{N{A)). Let G ^nxn-r 
be a lattice basis of L{N{R'^)) = {y G [ R^y = 0}, and s = n — m — r. 

With P constructed in this way, we have that: 

i) A = MP for some m x (m + s) integer matrix M. R Q Q implies L{N{Q^)) C 
L{N{R^)), and as G L{N{Q^)) and P"^ G L{N{R^)), the claim follows. 

ii) T = PS. 

Theorem 5 For any lattice basis R of a sublattice of L{N{A)) 

X = X^-P^ 
Y = Y^'^^ 

Proof: We show that X^ '^ C X^'^^ C X. li x £ X^*^, then there exists /i such 
that {x, fi) G U^'^ , and then multiplying through by -P, we see that {x, fi) G U^'^^ 
as PR = and thus x G X^'^^ . If a; G X^'^^, then left multiplying by M gives 
Ax = Ax^ = 6 as MPS' = AS = 0, and thus a; G As X^''^ = equality 

holds for all P. 

y7,Q _ yP,PS foUows immediately from Lemma[T]as P^ is a basis for L{N{R^)), 
and y-'^'Q = yAo follows from Lemma [Das A^ is a basis of L{N{Q)). □ 

Example 1 Consider a set X = {a; G Z^[Aa; = Aa;'^} of the form 

xi —5x2 —4x3 +11x4 +5x5 = a^x^ 
— 13xi —2x2 —12x3 —11x4 +2:5 = a^x^ 

G Z^. 



X 



1 -1 1 I and M 




1 5 
-12 -1 1 



Given 



-1 

it is easily checked that A = MP. 

Now as T = I 61 I is a basis of L{N{M)), it follows from Proposition [3] that 
1 / 

Ixi +la^3 +1x4 = p^x^ — 5/i 

Ixi +1x2 — la^3 +la;4 = p'^x^ +61/X 

— 1x2 — la^3 +2x4 +12:5 = p^x^ +l/i 

X G Z^, /i G Z^ 
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is an extended formulation for X. 

An alternative is to calculate a basis Q of L{N{A)), namely 



Q 



/ 1 -1 13 \ 

2 16 

1 -25 

-10 7 

V 2 3 -22 J 



Taking R to consist of the first two columns, and S to be the last column, we have 
that P'^ from above is a basis of L{N{R^)) and PS =1 61 I , so we arrive at the 
same extended formulation via the formulation of Theorem [5j □ 



3 Knapsack sets replaced by two equations 

Here we analyze the case m = 1 and s = 1 in more detail. Specifically we are interested 
in the sets X and Y when 

a = Mip^ + M2P^. 

We suppose that aj > for all 1 < j < n, that gcd(ai, . . . , a„) = 1 and that 
Mi,M2 > 0. Since gcd(ai, . . . , a„) = 1, it follows that gcd(Mi,M2) = 1, which 
implies the existence of integers q G with Miqi + M2q2 = 1. In addition we add 
the condition that HNF(P) = (7,0). Note that if HNF(P) = {D,0) with D ^ I, 
then it suffices to multiply the equation system by and work with P' = D^^P. 
From Proposition [3l we know that X^'^ = X, where U^'^ is of the form 

p^x = p^x° + M2/X 
p'^x = p^x^ - Mi/x 

X G Z",/i € I}. 

Note also that we can take p^x^ = qib for z = 1, 2 as Miqi + M2q2 = 1- This follows 
because ax^ - b = Mi{p^x^ - qib) + M2{p'^x^ - q2b) = and gcd(Mi, M2) = 1. 

In the rest of this section we add a nonnegativity constraint on x. Thus we consider 

X+ = X nZl = {x € \ ax = b} and 
Y+ = Yr\Rl = {x€Rl\ax = b}. 

We derive two results. The first concerns the width of the polyhedron ' in the 
direction /i. The second uses the width to derive a lower bound on the Frobenius 
number, simplifying and generalizing the result of Aardal and Lenstra [l] that is valid 
under the assumptions that p^ G Z>o and AI2 = 1. 
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3.1 The integer width 

The integer width of a rational polytope P in the integer direction d, wi{P,d), is 
defined as 

wi{P,d) = |_max{d^a; | x G P}\ - |"min{d^a; | x G P}] + 1 , 

and is equal to the number of parallel lattice hyperplanes in direction d that are 
intersecting P. 

Our goal is to calculate the integer width of 

yP,PS ^ |(-^^ fj,) xR\p^x - M2fi = qib, p^x + Mi^i = q2b} 

To do this, let 

V+'^^ = {{x, n) eMlxM\p^x- M2fi = qi, p^x + A/i/i = ^2} (2) 

be the scaled down version of this polyhedron with 6 = 1. 

Below we derive the values z = max{/i | {x, /i) G V^'^^} and z = min{^ | {x, fi) G 
' }. Once we have the values z and z it will be straightforward to compute the 

width «;7(V^"^^,e"+i) ^^^j _ p^^^ j_ ^ 

Lemma 6 Consider formulation V^'^^ and let k = argmax{i|pj^/aj} and j = 
argmin{i|pj/aj}. Then, 

^- andz- 



M2ak M2 ~ M2aj M2 
Proof: We consider the linear program 

z = max fi 

s.t. p^x - M2H = qi (3) 

p'^x + Min = q2 (4) 
xeM.1, /xGM^. 

Let 7 be the dual variables corresponding to constraints ©-(jl]). The corresponding 
dual problem is: 

z = min qi-fi + 0^272 (5) 
s.t. Pi 71+ Pi 72 > 0, 1 < i < n, (6) 
-M27i + Afi72 = 1, (7) 
7 G 

From constraint ^ we obtain 

71 = ^^^^. (8) 

' M2 ^ ^ 
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Substituting for 71 in constraint ([6]) yields 



Pi 



1 M172-I, 



Mo 



+ P, 72 > 0, l<i<n. 



Rewriting gives 72(1?^ +pj{Mi/M2)) —p\/M2 > for 1 < i < n, which in turn yields 
72 > — , 1 < i < n. We now obtain 



72 



Pi 



(9) 



Finally, we substitute for 7 in the dual objective function ^ using expressions 
and Q which yields the optimal dual objective value 



91 



Mi(p^/q,)-1 
M2 



, Pk Pk ( QiMi + 92^/2 
+ 92 — = — 



M2 



Qi 



Pi 



M2 M2ak M2 



The calculation of z is almost identical. 

Immediately we obtain the integer width. 
Theorem 7 



□ 



wiiV 



bpl bqi 



M2ak M2 



hp] 



bqi 

M2aj M2 



+ 1, 



where the indices j and k are defined as in Lemma O 

Notice that the choice of a valid q does not influence the width w{V^''^^ , e""*"^). 
Suppose q' G satisfies Miq[+M2q'2 = 1- The set of all valid (91, 92)^ can be written 
as 



<12 



1'2 



+ A 



-M2 
Ml 



where A € Z. Thus a different choice of qi just means that the whole interval [z, z] is 
shifted by an integer amount A. 

Observe also that given the choice of i?, any lattice basis P of L{N{RF)) yields 
the same width. The multipliers Mi, M2 as well as the values (71, q2 do however change 
with different choices of P. 

Example 2 Consider the following input vector a 

a = (12223, 12224, 36674, 61119, 85569). 
This is instance cuwwl from Cornuejols et al. [7]. With 



-10 2 
2 1 1 



-1 1 
6 6 
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and (Ml, M2) = (12225, 12224), we have that a = MP, HNF(P) = (/, 0). 

Now we apply Theorem [7] with right-hand side b = 89,643,481, which is the 
Frobenius number of a. We have j = 1, k = 3, qi = 1, q2 = —1- We obtain 



bpl 



M2ak 

89643481 
12224 



bqi 

M2 



bp] 
M2aj 



bqi 
M2 



+ 1 



36674 



89643481 ^ 



1 



12224 



bqi 

M2 



1 



bqi 
M2 



+ 1 



[-7333.00003J - [-7333.9999] + 1 



12223 
7334 + 7333 + 1 



+ 1 



0. 



It follows that U^'^^ = 0. Applying branch-and-bound, and branching first on the 
variable, this infeasibility would immediately be apparent. This is not the case using 
branch and bound starting from the original formulation X^'^ = {x € [ ax = fe}. 
In particular Cplex fails to prove infeasibility within 500 million nodes. □ 

A natural question is whether the integer width differs if we use a different member 
of the family of extended formulations. Consider the sets 

V_^'Q = {{x, fj,) G Rl X I Ix = Ix° + Sfi^ + 

and 

V^'^^ = {{x, n) eRlxR' \Px = Px^ + PS^i^} 
as described in Theorem [5l Using Lemma [H we have that 

Thus we have 

Proposition 8 wiiV^'^^ ,d) = wj{V^'^, (d, 0)), where d is any integer cost vector 
over the {x,fi^) variables. 

In particular, when m = 1, s = 1, and d is the unit vector corresponding to the last 
column of S, then u;/(yf e"+i) = u'7(V+'^, (e"+i,0)). 

3.2 A lower bound on the Frobenius number 

The Frobenius number of a, F{a), is the largest integer value of b such that ax = b 
does not have a nonnegative integer solution. Wlog we choose q such that < 
M2/2. So, if \q'i\ > M2/2, we can determine new valid values of qi,q2 such that 
Ig^l < M2/2 by identifying an appropriate value of A. In this section we still assume 
that HNF(P) = (7,0). 
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Theorem 9 Let a = Mip^ + Af2p^ with a, Mi, M2,p^ ,p'^ satisfying the assumptions 
given in the beginning of Section [21 Moreover, let z, z and the indices j and k be as 
defined in Lemma\^ 

If (-M2/2) < gi < and 

I > </! 

2a) Pl<M2+qi 

3a) (Mk^Z 
then 

F{a) > ^MM2 + qi) -pla, _ _M^ ^^^^ 
Pk(^j-Pjak ^-qi 

orifO<qi< M2/2 and 

lb) ^ > -M2 + qi 



2b) I < 51 



3b) i^Jz^Z, 
then 



ajak{M2 - qi) + p]ak M2 



F{a) > -^^^ 1 + -r 



- Pj^k ^-qi 
Proof: 

We have aheady determined the width of ' in the direction of fi correspond- 
ing to 6 = 1 in the proof of Lemma [6l Specifrcahy we have shown that /i hes in the 
interval [Ij, 1^], where 

li ■= z = and Ik := z = 

^ - Maoj M2 Maafc M2' 

whose width is 

D:=h- Ij = ^ > 0. 

M2ajak 

Any integer right-hand side value b = t for which the corresponding interval 
[tij, tik] does not contain an integer is a lower bound on the Frobenius number F{a). 
Below we will show that 

^ ^ aj_ak{M2 + qi) - p\aj M2 



p1^3 - P]^k ^-qi 
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is such a lower bound in the case that —M2/2 < gi < 0. A sketch of the proof for the 
case < gi < M2/2 is given in Appendix 1. 

If qi < 0, Assumptions la and 2a imply that < Ij < Ik < 1- Moreover, since 
qi > -M2/2 we obtain 4 < pl/{M2a2) + 1/2. Let s := Notice that 1 - 4 > 

since 4 < 1. The interval [slj, sik] has length 1 — I^. Notice that slj Z due to 
Assumption 3 of the theorem. Define i := [slj\ and s' := l/Ij- The number s' satisfies 
s — J- < s' < s, and yields the interval [-Z^!-,/^] := [s'lj, s'lk], with /' integral. The 

J J J 

length of [/j, is less than the length 1 — 4 of [slj, s/fc]. Therefore, [Ij, + Ik] has 
length less than 1, and since I'j is integral it follows that {Ipl'k + Ik] does not contain 
an integer. 

Now, define s* := [s'j + 1 and the interval [/*,/^] := [s*Ij, s*Ik]. We have 
Ij < Ij < Ij + Ij and I'k < Ik ^ Ik + ^k- The result that [/*, I^] does not contain an 
integer follows from the observation that {Ipl'k + ^k] does not contain an integer. 

We finally observe that 

s* = ls'\ + l>Ls-^J+l>s-^-l + l = s- ^, 

h h 

so we can conclude that s — j- = ^^jy^ — 7- yields a lower bound on the Frobenius 
number F{a). Rewriting ^^j^ — 7- results in the expression 

1-4 _ J_ _ ^ ~ ilk + Mi 1 _ ajak{M2 + qi) - pjaj _ M2 

D Ij ~ °.Pfc-«fcPj jj p\aj-p]ak ?l-a^' 

M2ajak M2aj M2 aj "1 

□ 

We notice the similarity with the expression for the lower bound on the Frobenius 
number derived by Aardal and Lenstra [4j for the case that M2 = 1 and G Z"o- 
we set M2 = 1 and g = in Expression (jlOp we obtain 

UjUk - pjaj _ aj_ 
- Pj(^k Pj ' 

The only difference in the two expressions is in the numerator of the first term, where 
we have p^flj instead of 2p^ak in [3]. This is a result of a different choice of the 
number s in the proof. In [4] s was chosen as s = (1 — 2Ij)/D under a constraint on 
the relationship between Ij and Ik- 

4 Computation 

4.1 Using reduced bases to find structure 

Aardal and Lenstra [Ij considered knapsack instances in which the input vector a can 
be decomposed as a = Mip^ + M2P^ , and used the reformulation earlier suggested in 
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[3], cf. formulation X^'^: 



X = + Qfj, , 

where x^ and Q is as described in Section [21 They observed that if a is long, 
and are short compared to a, and if the basis Q is reduced, then the first n — 2 
basis vectors of Q are short, and the last, (n — l)st basis vector is long. This can be 
explained as follows. First we observe that the orthogonal complement of the plane 
spanned by the vectors p^ and p^ is equal to N{P) C N{a). If and p^ are short, the 
lattice L{N{P)) contains short vectors yielding a relatively small lattice determinant. 
The rank of L(N(P)), which is a sublattice of L{N{a)), is just one less than the rank 
of L{N{a)). Moreover, the determinant of the lattice L{N{a)) is equal to the length 
of the vector a. So, the large value of d{L{N{a))) mainly has to be contributed by 
the basis vector that is in L{N{a)) but not in L(N{P)). Since basis reduction orders 
the basis vectors in nondecreasing order of length, up to a multiplier, this basis vector 
is the last one in a reduced basis. 

In general, we can derive a suitable decomposition of A, in case no such decom- 
position is known a priori, by using the following algorithm. 

i) Derive a reduced basis Q of L{N{A)), see ([1]) in Section [LTl 

ii) Suppose Q consists of s long vectors and r = n — m — s short ones. How to define 
"long" and "short" is up to the user. (If all vectors of Q are of approximately 
the same length we set s = n — m). We define R to be the set of short vectors 
of Q and S to be the set of long ones. 

iii) Find a reduced basis P^ of L{N{R^)). 

iv) Solve the system of equations MP = A, M € to find the matrix of 
multipliers M. 

Example 3 We consider the same instance as in Example [2] with 

a = (12223, 12224, 36674, 61119, 85569). 

Here we show how its hidden structure can be uncovered. 
A reduced basis of L{N{a)) is equal to 



Q 



( -3 -1 2059 \ 

1 1 -3 157 

-1 -1 -1 -3336 

-1 1 2687 

V 1 1 -806 / 



Here we observe that the last column of the reduced basis Q is much longer than the 
other columns. Taking r = 3 and s = 1, -R will consist of the first three columns of 
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Q, and S will consist of the last column of Q. A reduced basis 
L{N{R^)) is 



for the lattice 



V 



-1 2\ 

1 
2 1 

-1 6 

1 6 / 



The vector (Mi,M2) = (12225,12224) solves MP = a. We can now write a = 
12225p^ + 12224p^ with being the first row of -P, and being the second row 
of P. Note that the matrix P obtained is not unique. In Example 2 a closely related 
but different basis of L{N(R^)) is considered. □ 



4.2 Feasibility testing and quality of the Probenius bound 

We tested the quality of the extended formulations for different choices of s on 
some instances of integer equality knapsacks and the Cornuejols-Dawande market 
split problem. For all instances of both problem types we compute a reduced basis 
Q and a vector as described in Section II. H and derive matrices P and M as 
described in Section [dl 

The integer knapsack instances were taken from Aardal and Lenstra [4J • Instances 
probl-4 are such that the vector a decomposes with short p^ , p^, whereas for the 
instances probll-14 the a-coefficients, randomly generated from [/[lOOOO, 150000], 
are of the same size on average as in probl-4. Instances probll-14 have no apparent 
structure, and the columns of a reduced basis Q of L{N{A)) are of approximately 
the same length. We use the Frobenius number of the vector a as right-hand side 
coefficient for all knapsack instances. Instances probl-4 have 8 variables and problO- 
14 have 10 variables. For details of the instances, see 0]. 

The market split instances [6] are multiple row equality knapsack problems in 
{0, l}-variables with m rows and n = 10(m — 1) variables. The elements of a* for 
each row i are generated randomly from U[0, 99], and the right-hand side coefficients 
are calculated as bi = [{Yl]^=i We generated two sets of market split instances 

with 4 constraints and 30 variables, and 5 constraints and 40 variables respectively. 

In Tables [iHS] we report on the number of nodes used by the integer programming 
solver Xpress Version 16.01.01 [16j to solve the various reformulations. Column "orig" 
refers to the original formulation in a;-variables. Column "AHL" refers to the Aardal- 
Hurkens-Lenstra lattice reformulation in which the aj-variables have been removed 
from the formulation, i.e., the formulation {/i G Z"~^ | Qfi > — a;*^} in the knapsack 
case and the formulation {ll € Z"^™ I —x^ < Q/j, < 1 — x^} in the market split case. 
For formulations ' we report on results for different values of s. Notice that the 
formulations AHL and ' for s = n — m are mathematically equivalent, but the 

' -formulations contain the aj-variables with the identity matrix as coefficients. 
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Table 1: The number of branch-and-bound nodes needed to solve the various refor- 
mulations for the knapsack instances. 























Instance 


orig 


AHL 


s = 1 


s = 2 


s = 3 


s = 4 


s = 5 


s = 6 


s = 7 


s = 9 


probl 


> 100 mill. 


1 


59 


15 


3 


3 


1 


1 


1 




prob2 


> 100 mill. 


3 


23 


7 


3 


1 


1 


1 


1 




prob3 


> 100 mill. 


13 


37 


29 


5 


7 


11 


9 


5 




prob4 


> 100 mill. 


3 


13 


5 


1 


1 


1 


1 


1 




probl 1 


100,943 


61 


2237 


7683 


317 


89 


51 


69 


49 


61 


probl2 


160,783 


93 


10,981 


1105 


967 


523 


179 


105 


117 


71 


problS 


188,595 


91 


10,205 


12,261 


239 


321 


35 


57 


39 


59 


probl4 


140,301 


87 


2443 


627 


689 


389 


283 


115 


105 


87 



Since the solver reacts differently to the presence of the redundant a;-variables, this 
leads to slight deviations in the number of enumeration nodes needed. 

Instances probl-4, which decompose in short p^,p^, are very difficult to tackle 
with branch-and-bound applied to the original formulation. The Frobenius numbers 
for these instances are also large, see Table HI None of the instances could be solved 
within 100 million nodes. As could be expected, the C/_|_ ' -formulation with s = 1, 
which is a formulation with the a;-variables and one variable fj,, is easy to solve and 
comparable to the AHL-formulation. In contrast, instances probll-14 are solvable 
using the original formulation, mainly due to the smaller value of the right-hand side 
coefficients. Here, one could expect that we would need to set s = n — m to see a 
noticeable improvement compared to the original formulation, but in fact even taking 
s = 1 reduces the number of enumeration nodes by at least an order of magnitude, 
and with s around 5 we obtain results comparable to those obtained with the AHL- 
formulation. 



Table 2: The number of branch-and-bound nodes needed to solve the various refor- 
mulations: CD-instances 4 x 30. 













C/i^'^^-ref 






Instance 


orig 


AHL 


s = 1 


s = 5 


s = 10 


s = 15 


s = 20 


s = 26 


4 X 30_1 


157,569 


281 


124,695 


71641 


8033 


1397 


1021 


607 


4 X 30_2 


169,455 


167 


154,505 


51989 


3794 


1487 


610 


535 


4 X 30_3 


209,741 


325 


178,697 


181,373 


32,367 


1831 


1025 


845 


4 X 30_4 


202,513 


199 


156,047 


4685 


3583 


829 


493 


9527 


4 X 30_5 


115,173 


311 


73,151 


17,201 


1197 


391 


353 


3135 
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Table 3: The number of branch-and-bound nodes needed to solve the various refor- 
mulations: CD-instances 5 x 40. 













-ref 






Instance 


orig 


AHL 


s = 5 


s = 10 




s = 20 


s = 30 


s = 35 


5 X 40_1 


> 10, 000, 000 


5873 


> 10, 000, 000 


3,144,737 




160,701 


32,507 


32,099 


5 X 40_2 


> 10, 000, 000 


1643 


> 10, 000, 000 


2,821,042 




128,707 


30,302 


12,734 


5 X 40_3 


> 10, 000, 000 


7349 


> 10, 000, 000 


8,264,955 




86,483 


28,491 


25,541 


5 X 40_4 


> 10, 000, 000 


6870 


> 10, 000, 000 


1,854,280 




70,949 


19,616 


16,557 


5 X 40_5 


> 10, 000, 000 


6651 


> 10, 000, 000 


7,805,023 


1 


107,713 


35,989 


36,897 



For the market split instances, which have no clear structure of the Q-matrix, 
we notice similar results to those obtained for the knapsack instances probll-14. 
The algorithm of Section 14.11 prescribes s = n — m for these types of instances. 
The computational results suggest that smaller values of s already yield significant 
computational improvement. 

In Table H] we report on the value of the Frobenius number as well as the value 
produced by the lower bound given in Theorem [9l For instances probl-4 the lower 
bound is of the same order of magnitude as the Frobenius number, whereas for in- 
stances probll~14 the bound is off by an order of magnitude. The bound might be 
improved by a different choice of the value s in the proof of the theorem. 

Table 4: The value of the lower bound of the Frobenius number. 



Instance 


F{a) 


lower bound on F{a) 


probl 


33,367,335 


26,061,675 


prob2 


14,215,206 


10,894,273 


prob3 


58,424,799 


31,510,625 


prob4 


60,575,665 


56,668,034 


probll 


577,134 


98,774 


probl 2 


944,183 


113,114 


probl3 


765,260 


67,752 


probl 4 


680,230 


60,476 
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Appendix 1 

Proof of Theorem 6 for the case < qi < (M2/2). 

If < gi < (M2/2), Assumptions lb and 2b imply that -1 < Lj < 4 < 0, so the 
interval [Ij, 1^] does not contain an integer. In addition, Ij > / {M2aj) — 1/2. 

Let s := ^-jy-- The length of the interval [slj, sik] is equal to 1 + Ij, and since 
-1 < Ij <0 we have that < 1 + Ij < 1. 

Notice that sIk ^ Z due to Assumption 3b of the theorem. Define i := \slk\ 
and s' := I /Ik- The number ,s' satisfies s + < s' < s, and yields the interval 
[Ij,I'f/\ := [s'lj, s'lk], with integral. The length of [Ij,!^,] is less than the length 
1+Ij of [slj, sIk]- Therefore, [Ij+/j, I^] has length less than 1, and since is integral 
it follows that [/j + Ij,Ik) does not contain an integer. 

Now, define s* := [s'J + 1 and the interval [/*,I^] := [s*Ij, s*Ik]. We have 
Ij + Ij < Ij < Ij and /[. + Ik < II < I't,. The result that [/*, /^] docs not contain an 
integer follows from the observation that [/j + Ij,I'k) does not contain an integer. 

We finally observe that 

s* = [s'\ + l>[s + ]-\+l>s + ^-l + l = s + ^. 
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so we can conclude that s + = + yields a lower bound on the Probenius 

number F{a). Rewriting + results in the expression 

pi 

1 + 4 1 _ ^ + ~ ik 1 _ ajak{M2 - qi) + Pjak ^ M2 

D Ik~ °jPfc-°fcP) _pi pluj -p]ak ^ - «/ 
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